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video signal and generate pixels based on the received signal, a PIG generator coupled to the decoder that performs a real time weighted 
averaging to select a subset of the pixels; and a display generator to display the subset of the pixels in the PIG window on a monitor. 
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1 DECIMATION METHOD FOR PROVIDING PIG WINDOWS 

BACKGROUND OF THE INVENTION 

The present invention relates generally to graphical/video display systems and methods, 

5 and in particular to methods and systems for optimizing graphical/video displays, such as Picture- 

In-Guide ("PIG") windows and their memory requirements. 

Generally, televisions and television systems, such as computers to operate as televisions, 
provide information to a user through a display. One example is an electronic program guide 
("EPG")- An EPG provides a user or television viewer with updatable television schedule 

10 information in the form of an on-screen graphical display. The EPG may provide scheduling 
information for current and future broadcast programs as well as summaries of television 
program content for a particular program. The EPG may also provide one or more regions 
(windows) for previewing different television programs simultaneous with the displayed schedule 
information or with broadcast of the television program. Often the EPG divides the display into 

15 multiple portions or regions of varying size and resolution to provide multiple types of 
information. 

Conventionally, most television systems do not optimally use their available resources, 
such as memory space or processor bandwidth to effectively and efficiently provide information 
through the PIG window to a user. Therefore, there is a need for a method and system for 
20 providing a real-time and high quality video in a smaller PIG screen with minimum memory 
requirement. 

SUMMARY OF THE INVENTION 

The present invention is a decimation system and method for providing video data to a 
25 PIG window. One video pixel for every several video pixels is output, in real time, for the PIG 
window based on some (pixel) averaging algorithms. In one embodiment, only the two previous 
pixel lines are buffered, eliminating the need for buffering of the entire frame. This system 
produces real-time and high quality video in a smaller PIG screen with minimum memory 
requirement. 

30 In one embodiment, the system of the present invention includes an EPG system having 

a picture in guide window, a tuner to generate a video signal, a decoder coupled to the tuner to 
receive the video signal and generate pixels based on the received signal, a PIG generator coupled 
to the decoder that performs a real time weighted averaging to select a subset of the pixels; and 
a display generator to display the subset of the pixels in the PIG window on a monitor. 

35 Many of the features of this invention will be more readily appreciated as the same 

becomes better understood by reference to the following detailed description and considered in 
connection with the accompanying drawings. 
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1 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is an exemplary PIG display of an EPG according to one embodiment of the present 
invention; 

FIG. 2 is a simplified exemplary block diagram of a television system that includes a 
5 decimation system according to one embodiment of the present invention; 

FIG. 3 is an exemplary averaging window for three pixel lines according to one 
embodiment of the present invention . 

DETAIL DESCRIPTION 

10 This invention relates to a decimation system and method for providing video data to a 

PIG window, preferably in an EPG. In one embodiment of the present invention, one video pixel 
for every several video pixels is output for the PIG window based on some (pixel) averaging 
algorithms. The earliest versions of on-screen EPGs provided for the storage of program 
schedule information in an electronic memory connected to the television receiver and generally 

1 5 provided for the on-screen formatting and display of the program schedule information on the 
television screen. The early EPGs typically overlaid the television programming. Later EPGs 
provided PIG display of the television program simultaneous with the display of the EPG. In 
PIG format, the moving, real time images of one television channel are displayed on the 
background of the EPG in a PIG window overlaid on a small area of the background. 

20 The PIG display, according to one embodiment of the present invention, includes a real- 

time video image of a tuned television program displayed in a small window inset in a larger 
graphic guide. The PIG display provides many options to the viewer. The viewer may continue 
to view the television program s/he was watching before entering the guide while browsing 
through the television scheduling information in the guide. Alternatively, the program displayed 

25 in the PIG window may change for corresponding to a selected channel in the guide as the viewer 
cursors through program listings in the guide. The viewer may also pull up the PIG display to 
find out more information about the program s/he is currently watching, such as start/stop time 
or a program synopsis, while continuing to view the program in the inset PIG window. 

FIG. 1 illustrates a PIG display 10 of an electronic program guide (EPG) including a grid 

30 portion 22 and a picture window 12. The picture window 12, hereafter referred to as the PIG 
window, contains a video image of the television program displayed in the full-screen video 
display, but in reduced size, generally reduced by a factor of three in both width and height, i.e., 
1/9 the size of the screen. However, other reduction factors are also possible and are within the 
scope of the invention. Below window 12 are Panel Ad Windows 14, and 16 ("Ad Windows"). 

35 Windows 12, 14, and 16 each typically occupy about 1/9 of the total screen area. Another 
possible screen for display in a PIG system is a full-screen graphics display. The PIG window 
may also be used to display advertisement including text and video previews of goods, services, 
or television programs. 

-2- 
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1 The grid portion 22 of the PIG display 10 takes up a majority of the screen. The grid 

portion generally includes text, icons, and background graphics of several different colors. The 
graphics may include highlighting of text or sections of the screen. In an EPG system, the viewer 
can generally navigate through different guides without changing the television program 

5 displayed in the PIG window 12. The remainder of the screen area is typically occupied (moving 

from top to bottom of the screen) by an action key bar 1 8, a navigation bar 20, and an information 
box 24 (the "detailed information area")- 

In one embodiment of the present invention, when the viewer places a cursor on a different 
channel designation 52 or program title in the grid portion, the system automatically tunes the 

10 associated tuner to the selected channel and displays the program broadcast on that channel in 
the PIG window 12. 

According to one embodiment of the invention, the components necessary to generate a 
PIG display 10 are provided on a single chip to be incorporated into televisions, PC/TVs, VCRs, 
stand-alone units, satellite receivers, or the like. By providing all the components on a single 
15 chip, the overall package size can be reduced as well as the overall gate count and bus interface 
size of that chip. 

FIG. 2 is a block diagram of the components of one embodiment of the invention provided 
on a single chip 2 1 . These include a microprocessor 30, a memory controller or direct memory 
access (DMA) device 31, synchronization regenerating (synch) circuitry 28 and 78, VBI slicer 

20 37, NTSC decoder 79, PIG generator 32, pixel clock generator 38, display generator 34, color 
space converter 60, digital-to-analog conversion (DAC) 36, digital video output 80. 

The microprocessor 30 configures and coordinates the activities of all of the other 
components on the chip 21 via two-way communication paths without participating in any data 
movement operations, such as the VBI slicer 37 writing EPG data to memory via the DMA 

25 engine 3 1 . The microprocessor 30 accesses RAM 26 using the DMA engine 31 as a proxy by 
providing address information and either providing data (in the case of a write) or receiving data 
(in the case of a read). 

Preferably, there is only one RAM, although this invention will work with any number of 
RAMs. This RAM and the microprocessor 30 may be part of the chip 21 or may be external. 

30 The decision of internal versus external RAM and/or microprocessor is driven by economic and 
technological constraints. RAM 26 is accessed by four different components: the microprocessor 
30, the PIG generator 32, the VBI slicer 37, and the display generator 34. This places a high 
access load on the RAM as all four components may vie for access to the RAM simultaneously. 
If all access requests cannot be satisfied simultaneously (either by using a RAM that can access 

3 5 several bytes per cycle or using several RAMs or using a RAM whose cycle time is several times 
faster than the chip cycle time), a multiplexing device is necessary to resolve the arbitration 
between the components. Accordingly, the microprocessor 30, PIG generator 32, VBI slicer 37, 
and the display generator 34 each access the RAM 26 through the DMA 31. The DMA is a 

-3- 
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1 multiplexing and arbitrating circuit that facilitates the sharing of the RAM 26 by switching access 

between the four components in turn. The DMA may include buffer memory to temporarily store 
data input from out-of-turn components between access cycles. The DMA 3 1 stores text and 
video data in the correct addresses in the RAM 26 and then retrieves the appropriate data from 

5 a selected address from the RAM 26 when needed. 

In one embodiment, the system can receive two independent video signals from two 
independent tuners 50. In a unit with two tuners, this allows chip 21 to collect data from one 
channel while the user is in the guide viewing a different channel. Other embodiments with more 
than two timers for receiving more than two video signals to display in a plurality of PIG 

1 0 windows are also possible. In a unit with one tuner, both video inputs would be connected to the 
one tuner. 

The picture video input 76 from one of the tuners 50 is connected to the NTSC decoder 
79. The NTSC decoder takes an analog input and outputs digital pixels either R,G,B or Y,U,V 
in sufficient resolution for the desired PIG picture quality. 

15 To implement a low-cost PIG device for use in a PIG system, the incoming video data is 

decimated before the video data is stored in a memory device. Thus the resulting PIG has a 
limited resolution. In one embodiment, a weighted averaging algorithm is used to select one 
pixel out of nine pixels (decimation by 9). The incoming digitized video data is buffered in a 
low-cost memory, such as a shift register, to carry out the averaging algorithm. 

20 For example, for an immediate neighbor averaging, the adjacent pixels in a sliding 

window (nine pixels) for the current line, the two previous lines are stored in the buffer (shift 
register) and the desired averaging function is performed on them to obtain one weighted pixel 
for each nine pixels. The resulting pixel is then converted to video signal for display in a PIG 
window, or it is stored in memory to be used for PIG window display. For a nine pixel sliding 

25 window, only two previous lines of video data need to be buffered. 

Referring now to FIG. 3, sliding window 130 contains nine pixels. The two previous lines 
1 and m are buffered. When pixel Pnj+1 of the new line n arrives, the averaging algorithm is 
performed, and the resulting (weighted) pixel is output in real time. When the next pixel Pnj+2 
arrives, it is buffered but, the averaging algorithm is not performed until Pnj+3 and Pnj+4 arrive. 

30 As Pnj+4 arrives, the sliding window shifts to the right by three pixels to position 131. The 
averaging algorithm is performed and again, the next (weighted) pixel is output in real time. 
When the end of line is reached, the sliding window moves down by three pixels to the 
beginning of lines Ln+1, Ln+2, and Ln+3. No decimation is carried out until lines Ln+1 and 
Ln+2 are buffered. Once lines Ln+1 and Ln+2 are buffered, the decimation continues as 

35 indicated above. 
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The following illustrates an example for a polynomial weighted averaging algorithm: 



10 



20 



25 



35 



Field Line Pixels 

1 1 1234 56789 

2 1 1234 5 6789 

1 2 12 3 456789 

2 2 12 3456789 

1 3 1234567 8 9 

2 3 123456789 



As field 1, line 1 is received, pixels 1,2, and 3 are summed together and stored, similarly 
for 4, 5, and 6 and 7, 8, and 9. The same procedure is used for line 3. The procedure is repeated 
for every line in field 1 . When field 2 is received, field 2, line 1 is added to field 1, line 1 and 
field 1, line 3. Field 2, line 2 and field 2, line 3 are added to field 1, line 3, etc. 
1 5 Note: pixel locations are marked (field-line-pixel). A field is assumed to have lines 1 - 

240 inclusive active video lines. Each line is assumed to have 640 pixels. 

The locations in memory after the first field is received would be: 
memory[l] = (1-1-1) + 2*(l-l-2) + (1-1-3) + (1-2-1) + 2*(l-2-2) + (1-2-3) 
memory[2] = (1-1-4) + 2*(l-l-5) + (1-1-6) + (1-2-7) + 2*(l-2-8) + (1-2-9) 



memory[213] = (1-1-637) + 2*(l-l-638) + (1-1-639) + (1-2-637) + 2*(l-2-638) + (1-2-639) 
memory[214] = 2*(l-3-l) + 4*(l-3-2) + 2*(l-3-3) 
memory[215] = 2*(l-3-4) + 4*(l-3-5) + 2*(l-3-6) 



memory[426] = 2*(l-3-637) + 4*(l-3-638) + 2*(l-3-639) 

memory[33868] = 2*(l-240-l) + 4*(l-240-2) + 2*(l-240-3) 

30 memory[34080] = 2*(l-240-637) + 4*(l-240-638) + 2*(l-240-639) 

As the second field is received, the following pixels are output: 
pixel[l] = {memory [1] + 2*(2-l-l) + 4*(2-l-2) + 2*(2-l-3)}/16 
pixel[2] = {memory[2] + 2*(2-l-4) + 4*(2-l-5) + 2*(2-l-6)}/16 



pixel[213] = {memory[213] + 2*(2-l-637) + 4*(2-l-638) + 2*(2-l-639)}/16 

pixel[214] = {memory[214] + (2-2-1) + 2*(2-2-2) + (2-2-3) + (2-3-1) + 2*(2-3-2) + (2-3-3)}/16 
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1 The memory is updated with terms involving field 2 only. 

memory[l] = 2*(2-l-l) + 4*(2-l-2) + 2*(2-l-3) 
memory[2] = 2*(2-l-4) + 4*(2-l-5) + 2*(2-l-6) 

5 memory[213] = 2*(2-l-637) + 4*(2-l-638) + 2*(2-l-639) 

memory[214] = (2-2-1) + 2*(2-2-2) + (2-2-3) + (2-3-1) + 2* (2-3-2) + 
(2-3-3) 

As the next field 1 is received the output pixels are: 
10 pixel[l] = {memory[l] + (1-1-1) + 2*(l-l-2) + (1-1-3) + (1-2-1) + 2+( 1-2-2) + (l-2-3)}/16 
and so on.... 

This algorithm converts every nine pixels into one pixel using polynomial weighted 
averaging with binary coefficients, without having to store the entire frames. As a result, a PIG 
window of a one-ninth the size of the original display window is generated. The picture is de- 
15 interlaced before the averaging and then re-interlaced after the averaging is completed. 

Assuming the binary coefficients for the nine-pixel window are 

a,b, c, 
d, e, f, 
g,h, i, 

20 in one embodiment, the transfer function performed by the algorithm is: (a + 2b + c + 2d + 4e + 
2f + g + 2h + i)/16. The averaging algorithm is performed in real time before the video data is 
stored. A minimum amount of memory is needed because only the two previous lines of each 
field, sufficient for carrying out the algorithm, are stored. The algorithm also counter balances 
the motion effects by assigning a heavier weight to the center pixel (i.e., 4e). 

25 It will be recognized by those skilled in the art that various modifications may be made 

to the illustrated and other embodiments of the invention described above, without departing 
from the broad inventive scope thereof. It will be understood therefore that the invention is not 
limited to the particular embodiments or arrangements disclosed, but is rather intended to cover 
any changes, adaptations or modifications which are within the scope and spirit of the invention 

30 as defined by the appended claims. 



35 
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1 WHAT IS CLAIMED IS: 

1 . An electronic program guide (EPG) system including a picture in guide (PIG) 
window comprising: 

5 a monitor having a display screen; 

a tuner to generate a video signal; 

a decoder coupled to the tuner to receive the video signal and generate pixels based 
on the received signal; 

a PIG generator coupled to the decoder that performs a real time weighted 
10 averaging to select a subset of the pixels; and 

a display generator to display the subset of the pixels in the PIG window on the 
display screen. 

2. The EPG system of claim 1, wherein the PIG generator performs the real time 
15 weighted averaging to select one pixel out of nine pixels. 

3. The EPG system of claim 2, further comprising a memory to buffer the generated 

pixels. 

20 4. The EPG system of claim 3 , wherein the memory buffers 3 adjacent pixels in a 3x3 

sliding window for the current line and the previous two lines, and the PIG generator performs 
the real time weighted averaging to select one pixel out of the nine pixels from the sliding 
window. 

25 5. The EPG system of claim 1, wherein the PIG generator performs a real time 

polynomial weighted averaging with binary coefficients. 

6. The EPG system of claim 4, wherein the PIG generator in real time selects one 
pixel out of the nine pixels based on a transfer function of (a + 2b + c +2d +4e +2f + g + 2h 

30 +i)/l 6, wherein a, b, c, d, e, f, g, h, and i are binary coefficients for the respective pixels in the 
3x3 sliding window, 

7. The EPG system of claim 1, further comprising means for displaying in the PIG 
window information about a television program. 

35 

8. The EPG system of claim 1, further comprising: 

means for displaying television program listings in a first area of the screen; 
an input device to selectively mark one of the displayed program listings; and 

-7- 
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1 means responsive to the input device for controlling the display generator to display 

in the PIG window simultaneously with the program listings video clips of the marked program. 

9. The EPG system of claim 8, wherein the marked program is a currently telecast 
5 television program and the video clip is a live telecast of the marked program. 

10. The EPG system of claim 8, wherein the marked program is a future telecast 
television program and the video clip is a preview of the marked program. 

10 1 1 . A television system for receiving a video signal, comprising: 

a monitor having a display screen; 

a plurality of timers to generate a plurality of video signals that carry video 
programs and data related to the video programs; 

a PIG chip coupled to the monitor and the tuners to display a first image in a PIG 
1 5 window on the screen based on a video signal generated by one of the plurality of tuners, wherein 
the PIG chip performs a real time weighted averaging to select one pixel out of nine pixels from 
the video signal to display the respective program in the PIG window on the screen; and 

means for coupling the program related data to the PIG chip so as to display the 
data in a second area on the screen contemporaneously with the program displayed in the PIG 
20 window. 

12. The television system of claim 1 1, further comprising a memory to buffer pixels 
corresponding to a subset of the generated video signals. 

25 13. The television system of claim 12, wherein the memory buffers 3 adjacent pixels 

in a 3x3 sliding window for the current line and the previous two lines of the video signal 
generated by one of the plurality of tuners, and the PIG chip performs the real time weighted 
averaging to select one pixel out of the nine pixels in the sliding window. 

30 14. The EPG system of claim 13, wherein the PIG chip in real time selects one pixel 

out of the nine pixels based on a transfer function of (a + 2b + c +2d +4e +2f + g + 2h +i)/l 6, 
wherein a, b, c, d, e, f, g, h, and i are binary coefficients for the respective pixels in the 3x3 
sliding window. 

35 1 5. A method for providing video data to a picture in guide (PIG) window displayed 

on a monitor, the method comprising the steps of: 
receiving a video signal; 
generating pixels based on the received signal; 

-8- 
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1 performing a real time weighted averaging to select a subset of the pixels; and 

displaying the subset of the pixels in the PIG window on the monitor. 

16. The method of claim 15, further comprising the step of buffering the generated 

5 pixels. 

17. The method of claim 16, wherein the step of buffering comprises buffering 3 
adjacent pixels in a 3x3 sliding window for the current line and the previous two lines, and the 
step of performing a real time weighted averaging comprises performing the real time weighted 

1 0 averaging for selecting one pixel out of the nine pixels in the sliding window. 

18. The method of claim 17, wherein the step of performing a real time weighted 
averaging comprises selecting one pixel out of the nine pixels based on a transfer function of (a 
+ 2b + c +2d +4e +2f + g + 2h +i)/16, wherein a, b, c, d, e, f, g, h, and i are binary coefficients 

1 5 for the respective pixels in the 3x3 sliding window. 

19. The method of claim 15, further comprising displaying in the PIG window 
information about a television program. 

20 20. The method of claim 1 5, further comprising: 

displaying television program listings in a first area of the screen; 
selectively marking one of the displayed program listings; and 
controlling the display generator to display in the PIG window simultaneously with 
the program listings video clips of the marked program. 

21. The method of claim 20, wherein the marked program is a currently telecast 
television program and the video clip is a live telecast of the marked program. 

22. The method of claim 20, wherein the marked program is a future telecast television 
30 program and the video clip is a preview of the marked program. 



35 
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AMENDED CLAIMS 

! [received by the International Bureau on 15 August 2000 (15.08.00); 

original claims 1 and 1 5 amended; remaining claims unchanged (3 pages)] 

1 . An electronic program guide (EPG) system including a picture in guide (PIG) 
window comprising: 
5 a monitor having a display screen; 

a tuner to generate a video signal; 

a decoder coupled to the tuner to receive the video signal and generate pixels based 
on the received signal; 

a PIG generator coupled to the decoder that performs, a real time weighted 
1 0 averaging to [select] generate a subset of the pixels as a line of pixels is generated bv the decoder : 
and 

a display generator to display the subset of the pixels in the PIG window on the 
display screen. 

15 2. The EPG system of claim 1, wherein the PIG generator performs the real time 

weighted averaging to select one pixel out of nine pixels. 

3. The EPG system of claim 2, further comprising a memory to buffer the generated 

pixels. 

20 

4. The EPG system of claim 3, wherein the memory buffers 3 adjacent pixels in a 3x3 
sliding window for the current line and the previous two lines, and the PIG generator performs 
the real time weighted averaging to select one pixel out of the nine pixels from the sliding 
window. 

25 

5. The EPG system of claim 1, wherein the PIG generator performs a real time 
polynomial weighted averaging with binary coefficients. 

6. The EPG system of claim 4, wherein the PIG generator in real time selects one 
30 pixel out of the nine pixels based on a transfer function of (a + 2b + c +2d +4e +2f + g + 2h 

+i)/16, wherein a, b, c, d, e, f, g, h, and i are binary coefficients for the respective pixels in the 
3x3 sliding window. 

7. The EPG system of claim 1 , further comprising means for displaying in the PIG 
35 window information about a television program. 

8. The EPG system of claim 1 , further comprising: 

means for displaying television program listings in a first area of the screen; 
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an input device to selectively mark one of the displayed program listings; and 
means responsive to the input device for controlling the display generator to display 
in the PIG window simultaneously with the program listings video clips of the marked program. 

9. The EPG system of claim 8, wherein the marked program is a currently telecast 
television program and the video clip is a live telecast of the marked program. 

10. The EPG system of claim 8, wherein the marked program is a future telecast 
television program and the video clip is a preview of the marked program. 

11. A television system for receiving a video signal, comprising: 
a monitor having a display screen; 

a plurality of tuners to generate a plurality of video signals that carry video 
programs and data related to the video programs; 

a PIG chip coupled to the monitor and the tuners to display a first image in a PIG 
window on the screen based on a video signal generated by one of the plurality of tuners, wherein 
the PIG chip performs a real time weighted averaging to select one pixel out of nine pixels from 
the video signal to display the respective program in the PIG window on the screen; and 

means for coupling the program related data to the PIG chip so as to display the 
data in a second area on the screen contemporaneously with the program displayed in the PIG 
window. 

12. The television system of claim 11, further comprising a memory to buffer pixels 
corresponding to a subset of the generated video signals. 

13. The television system of claim 12, wherein the memory buffers 3 adjacent pixels 
in a 3x3 sliding window for the current line and the previous two lines of the video signal 
generated by one of the plurality of tuners, and the PIG chip performs the real time weighted 
averaging to select one pixel out of the nine pixels in the sliding window. 

14. The EPG system of claim 1 3, wherein the PIG chip in real time selects one pixel 
out of the nine pixels based on a transfer function of (a + 2b + c +2d +4e +2f + g + 2h +i)/16, 
wherein a, b, c, d, e, f, g, h, and i are binary coefficients for the respective pixels in the 3x3 
sliding window. 

15. A method for providing video data to a picture in guide (PIG) window displayed 
on a monitor, the method comprising the steps of: 

receiving a video signal; 
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generating pixels based on the received signal; 

performing a real time weighted averaging to [select] generate a subset of the pixels 
as a line of pixels is generated by the decoder : and 

displaying the subset of the pixels in the PIG window on the monitor. 

16. The method of claim 15, further comprising the step of buffering the generated 

pixels. 

17. The method of claim 16, wherein the step of buffering comprises buffering 3 
10 adjacent pixels in a 3x3 sliding window for the current line and the previous two lines, and the 

step of performing a real time weighted averaging comprises performing the real time weighted 
averaging for selecting one pixel out of the nine pixels in the sliding window. 

18. The method of claim 17, wherein the step of performing a real time weighted 
1 5 averaging comprises selecting one pixel out of the nine pixels based on a transfer function of (a 

+ 2b + c +2d +4e +2f + g + 2h +i)/16, wherein a, b, c, d, e, f, g, h, and i are binary coefficients 
for the respective pixels in the 3x3 sliding window. 

19. The method of claim 15, further comprising displaying in the PIG window 
20 information about a television program. 

20. The method of claim 15, further comprising: 

displaying television program listings in a first area of the screen; 
selectively marking one of the displayed program listings; and 
25 controlling the display generator to display in the PIG window simultaneously with 

the program listings video clips of the marked program. 



30 



21. The method of claim 20, wherein the marked program is a currently telecast 
television program and the video clip is a live telecast of the marked program. 

22. The method of claim 20, wherein the marked program is a future telecast television 
program and the video clip is a preview of the marked program. 

CMR PAS266788. 1 -'-8/10/00 2:05 PM 
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1 DECIMATION METHOD FOR PROVIDING PIG WINDOWS 

BACKGROUND OF THE INVENTION 

The present invention relates generally to graphical/video display systems and methods, 

5 and in particular to methods and systems for optimizing graphical/video displays, such as Picture- 

In-Guide ("PIG") windows and their memory requirements. 

Generally, televisions and television systems, such as computers to operate as televisions, 
provide information to a user through a display. One example is an electronic program guide 
("EPG"). An EPG provides a user or television viewer with updatable television schedule 

10 information in the form of an on-screen graphical display. The EPG may provide scheduling 
information for current and future broadcast programs as well as summaries of television 
program content for a particular program. The EPG may also provide one or more regions 
(windows) for previewing different television programs simultaneous with the displayed schedule 
information or with broadcast of the television program. Often the EPG divides the display into 

15 multiple portions or regions of varying size and resolution to provide multiple types of 
information. 

Conventionally, most television systems do not optimally use their available resources, 
such as memory space or processor bandwidth to effectively and efficiently provide information 
through the PIG window to a user. Therefore, there is a need for a method and system for 
20 providing a real-time and high quality video in a smaller PIG screen with minimum memory 
requirement. 

SUMMARY OF THE INVENTION 

The present invention is a decimation system and method for providing video data to a 
25 PIG window. One video pixel for every several video pixels is output, in real time, for the PIG 
window based on some (pixel) averaging algorithms. In one embodiment, only the two previous 
pixel lines are buffered, eliminating the need for buffering of the entire frame. This system 
produces real-time and high quality video in a smaller PIG screen with minimum memory 
requirement. 

30 In one embodiment, the system of the present invention includes an EPG system having 

a picture in guide window, a tuner to generate a video signal, a decoder coupled to the tuner to 
receive the video signal and generate pixels based on the received signal, a PIG generator coupled 
to the decoder that performs a real time weighted averaging to select a subset of the pixels; and 
a display generator to display the subset of the pixels in the PIG window on a monitor. 

35 Many of the features of this invention will be more readily appreciated as the same 

becomes better understood by reference to the following detailed description and considered in 
connection with the accompanying drawings. 
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1 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is an exemplary PIG display of an EPG according to one embodiment of the present 
invention; 

FIG. 2 is a simplified exemplary block diagram of a television system that includes a 
5 decimation system according to one embodiment of the present invention; 

FIG. 3 is an exemplary averaging window for three pixel lines according to one 
embodiment of the present invention . 

DETAIL DESCRIPTION 
10 This invention relates to a decimation system and method for providing video data to a 

PIG window, preferably in an EPG. In one embodiment of the present invention, one video pixel 
for every several video pixels is output for the PIG window based on some (pixel) averaging 
algorithms. The earliest versions of on-screen EPGs provided for the storage of program 
schedule information in an electronic memory connected to the television receiver and generally 
15 provided for the on-screen formatting and display of the program schedule information on the 
television screen. The early EPGs typically overlaid the television programming. Later EPGs 
provided PIG display of the television program simultaneous with the display of the EPG. In 
PIG format, the moving, real time images of one television channel are displayed on the 
background of the EPG in a PIG window overlaid on a small area of the background. 
20 The PIG display, according to one embodiment of the present invention, includes a real- 

time video image of a tuned television program displayed in a small window inset in a larger 
graphic guide. The PIG display provides many options to the viewer. The viewer may continue 
to view the television program s/he was watching before entering the guide while browsing 
through the television scheduling information in the guide. Alternatively, the program displayed 
25 in the PIG window may change for corresponding to a selected channel in the guide as the viewer 
cursors through program listings in the guide. The viewer may also pull up the PIG display to 
find out more information about the program s/he is currently watching, such as start/stop time 
or a program synopsis, while continuing to view the program in the inset PIG window. 

FIG. 1 illustrates a PIG display 1 0 of an electronic program guide (EPG) including a grid 
30 portion 22 and a picture window 12. The picture window 12, hereafter referred to as the PIG 
window, contains a video image of the television program displayed in the full-screen video 
display, but in reduced size, generally reduced by a factor of three in both width and height, i.e., 
1/9 the size of the screen. However, other reduction factors are also possible and are within the 
scope of the invention. Below window 12 are Panel Ad Windows 14, and 1 6 ("Ad Windows"). 
35 Windows 12, 14, and 16 each typically occupy about 1/9 of the total screen area. Another 
possible screen for display in a PIG system is a full-screen graphics display. The PIG window 
may also be used to display advertisement including text and video previews of goods, services, 
or television programs. 

-2- 
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1 The grid portion 22 of the PIG display 10 takes up a majority of the screen. The grid 

portion generally includes text, icons, and background graphics of several different colors. The 
graphics may include highlighting of text or sections of the screen. In an EPG system, the viewer 
can generally navigate through different guides without changing the television program 

5 displayed in the PIG window 12. The remainder of the screen area is typically occupied (moving 

from top to bottom of the screen) by an action key bar 1 8, a navigation bar 20, and an information 
box 24 (the "detailed information area"). 

In one embodiment of the present invention, when the viewer places a cursor on a different 
channel designation 52 or program title in the grid portion, the system automatically tunes the 

10 associated tuner to the selected channel and displays the program broadcast on that channel in 
the PIG window 12. 

According to one embodiment of the invention, the components necessary to generate a 
PIG display 1 0 are provided on a single chip to be incorporated into televisions, PC/TV s, VCRs, 
stand-alone units, satellite receivers, or the like. By providing all the components on a single 
1 5 chip, the overall package size can be reduced as well as the overall gate count and bus interface 
size of that chip. 

FIG. 2 is a block diagram of the components of one embodiment of the invention provided 
on a single chip 21 . These include a microprocessor 30, a memory controller or direct memory 
access (DMA) device 31, synchronization regenerating (synch) circuitry 28 and 78, VBI slicer 
20 37, NTSC decoder 79, PIG generator 32, pixel clock generator 38, display generator 34, color 
space converter 60, digital-to-analog conversion (DAC) 36, digital video output 80. 

The microprocessor 30 configures and coordinates the activities of all of the other 
components on the chip 21 via two-way communication paths without participating in any data 
movement operations, such as the VBI slicer 37 writing EPG data to memory via the DMA 
25 engine 3 1 . The microprocessor 30 accesses RAM 26 using the DMA engine 3 1 as a proxy by 
providing address information and either providing data (in the case of a write) or receiving data 
(in the case of a read). 

Preferably, there is only one RAM, although this invention will work with any number of 
RAMs. This RAM and the microprocessor 30 may be part of the chip 21 or may be external. 

30 The decision of internal versus external RAM and/or microprocessor is driven by economic and 
technological constraints. RAM 26 is accessed by four different components: the microprocessor 
30, the PIG generator 32, the VBI slicer 37, and the display generator 34. This places a high 
access load on the RAM as all four components may vie for access to the RAM simultaneously. 
If all access requests cannot be satisfied simultaneously (either by using a RAM that can access 

35 several bytes per cycle or using several RAMs or using a RAM whose cycle time is several times 
faster than the chip cycle time), a multiplexing device is necessary to resolve the arbitration 
between the components. Accordingly, the microprocessor 30, PIG generator 32, VBI slicer 37, 
and the display generator 34 each access the RAM 26 through the DMA 31. The DMA is a 

-3- 



RNsnnnin- <rWO oos9213A1 IA> 



WO 00/59213 



PCT/US00/08591 



1 multiplexing and arbitrating circuit that facilitates the sharing of the RAM 26 by switching access 

between the four components in turn. The DMA may include buffer memory to temporarily store 
data input from out-of-tum components between access cycles. The DMA 3 1 stores text and 
video data in the correct addresses in the RAM 26 and then retrieves the appropriate data from 

5 a selected address from the RAM 26 when needed. 

In one embodiment, the system can receive two independent video signals from two 
independent tuners 50. In a unit with two tuners, this allows chip 21 to collect data from one 
channel while the user is in the guide viewing a different channel. Other embodiments with more 
than two tuners for receiving more than two video signals to display in a plurality of PIG 

1 0 windows are also possible. In a unit with one tuner, both video inputs would be connected to the 
one tuner. 

The picture video input 76 from one of the tuners 50 is connected to the NTSC decoder 
79. The NTSC decoder takes an analog input and outputs digital pixels either R,G,B or Y,U,V 
in sufficient resolution for the desired PIG picture quality. 

1 5 To implement a low-cost PIG device for use in a PIG system, the incoming video data is 

decimated before the video data is stored in a memory device. Thus the resulting PIG has a 
limited resolution. In one embodiment, a weighted averaging algorithm is used to select one 
pixel out of nine pixels (decimation by 9). The incoming digitized video data is buffered in a 
low-cost memory, such as a shift register, to carry out the averaging algorithm. 

20 For example, for an immediate neighbor averaging, the adjacent pixels in a sliding 

window (nine pixels) for the current line, the two previous lines are stored in the buffer (shift 
register) and the desired averaging function is performed on them to obtain one weighted pixel 
for each nine pixels. The resulting pixel is then converted to video signal for display in a PIG 
window, or it is stored in memory to be used for PIG window display. For a nine pixel sliding 

25 window, only two previous lines of video data need to be buffered. 

Referring now to FIG. 3, sliding window 1 30 contains nine pixels. The two previous lines 
1 and m are buffered. When pixel Pnj+1 of the new line n arrives, the averaging algorithm is 
performed, and the resulting (weighted) pixel is output in real time. When the next pixel Pnj+2 
arrives, it is buffered but, the averaging algorithm is not performed until Pnj+3 and Pnj+4 arrive. 

30 As Pnj+4 arrives, the sliding window shifts to the right by three pixels to position 131. The 
averaging algorithm is performed and again, the next (weighted) pixel is output in real time. 
When the end of line is reached, the sliding window moves down by three pixels to the 
beginning of lines Ln+1, Ln+2, and Ln+3. No decimation is carried out until lines Ln+1 and 
Ln+2 are buffered. Once lines Ln+1 and Ln+2 are buffered, the decimation continues as 

35 indicated above. 
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20 



25 



35 



The following illustrates an example for a polynomial weighted averaging algorithm: 

Field Line Pixels 

1 1 123456789 

2 1 123 456789 

1 2 123456789 

2 2 123456789 

1 3 123456789 

2 3 123456789 



As field 1 , line 1 is received, pixels 1, 2, and 3 are summed together and stored, similarly 
for 4, 5, and 6 and 7, 8, and 9. The same procedure is used for line 3. The procedure is repeated 
for every line in field 1 . When field 2 is received, field 2, line 1 is added to field 1, line 1 and 
field 1, line 3. Field 2, line 2 and field 2, line 3 are added to field 1, line 3, etc. 
1 5 Note: pixel locations are marked (field-line-pixel). A field is assumed to have lines 1 - 

240 inclusive active video lines. Each line is assumed to have 640 pixels. 

The locations in memory after the first field is received would be: 
memory[l] = (1-1-1) + 2*(l-l-2) + (1-1-3) + (1-2-1) + 2*(l-2-2) + (1-2-3) 
memory[2] = (1-1-4) + 2*(l-l-5) + (1-1-6) + (1-2-7) + 2*(l-2-8) + (1-2-9) 



memory[213] = (1-1-637) + 2*(l-l-638) + (1-1-639) + (1-2-637) + 2*(l-2-638) + (1-2-639) 
memory[214] = 2*(l-3-l) + 4*(l-3-2) + 2*(l-3-3) 
memory[215] = 2*(l-3-4) + 4*(l-3-5) + 2*(l-3-6) 



memory[426] = 2*(l-3-637) + 4*(l-3-638) + 2*(l-3-639) 

memory[33868] = 2*(l-240-l) + 4*(l-240-2) + 2*(l-240-3) 

30 memory[34080] = 2*(l-240-637) + 4*(l-240-638) + 2*(l-240-639) 

As the second field is received, the following pixels are output: 
pixel[l] = {memory[l] + 2*(2-l-l) + 4*(2-l-2) + 2*(2-l-3)}/16 
pixel[2] = {memory[2] + 2*(2-l-4) + 4*(2-l-5) + 2*(2-l-6)}/16 



pixel[213] = {memory[213] + 2*(2-l-637) + 4*(2-l-638) + 2*(2-l-639)}/16 

pixel[214] = {memory[214] + (2-2-1) + 2*(2-2-2) + (2-2-3) + (2-3-1) + 2*(2-3-2) + (2-3-3)}/16 
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1 The memory is updated with terms involving field 2 only. 

memory[l] = 2*(2-l-l) + 4*(2-l-2) + 2*(2-l-3) 
memory[2] = 2*(2-l-4) + 4*(2-l-5) + 2*(2-l-6) 

5 memory[213] = 2*(2-l-637) + 4*(2-l-638) + 2*(2-l-639) 

memory[214] = (2-2-1) + 2*(2-2-2) + (2-2-3) + (2-3-1) + 2*(2-3-2) + 
(2-3-3) 

As the next field 1 is received the output pixels are: 
10 pixel[l] = {memory[l] + (1-1-1) + 2*(l-l-2) + (1-1-3) + (1-2-1) + 2*(l-2-2) + (l-2-3)}/16 
and so on.... 

This algorithm converts every nine pixels into one pixel using polynomial weighted 
averaging with binary coefficients, without having to store the entire frames. As a result, a PIG 
window of a one-ninth the size of the original display window is generated. The picture is de- 
1 5 interlaced before the averaging and then re-interlaced after the averaging is completed. 
Assuming the binary coefficients for the nine-pixel window are 

a, b, c, 
d,e, f, 
g, h, i, 

20 in one embodiment, the transfer function performed by the algorithm is: (a + 2b + c + 2d + 4e + 
2f + g + 2h + i)/16. The averaging algorithm is performed in real time before the video data is 
stored. A minimum amount of memory is needed because only the two previous lines of each 
field, sufficient for carrying out the algorithm, are stored. The algorithm also counter balances 
the motion effects by assigning a heavier weight to the center pixel (i.e., 4e). 

25 It will be recognized by those skilled in the art that various modifications may be made 

to the illustrated and other embodiments of the invention described above, without departing 
from the broad inventive scope thereof. It will be understood therefore that the invention is not 
limited to the particular embodiments or arrangements disclosed, but is rather intended to cover 
any changes, adaptations or modifications which are within the scope and spirit of the invention 

30 as defined by the appended claims. 
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1 WHAT IS CLAIMED IS: 

1. An electronic program guide (EPG) system including a picture in guide (PIG) 
window comprising: 

5 a monitor having a display screen; 

a tuner to generate a video signal; 

a decoder coupled to the tuner to receive the video signal and generate pixels based 

on the received signal; 

a PIG generator coupled to the decoder that performs a real time weighted 
10 averaging to select a subset of the pixels; and 

a display generator to display the subset of the pixels in the PIG window on the 

display screen. 

2. The EPG system of claim 1 , wherein the PIG generator performs the real time 
15 weighted averaging to select one pixel out of nine pixels. 

3. The EPG system of claim 2, further comprising a memory to buffer the generated 

pixels. 

20 4. The EPG system of claim 3 , wherein the memory buffers 3 adjacent pixels in a 3 x3 

sliding window for the current line and the previous two lines, and the PIG generator performs 
the real time weighted averaging to select one pixel out of the nine pixels from the sliding 
window. 

25 5. The EPG system of claim 1, wherein the PIG generator performs a real time 

polynomial weighted averaging with binary coefficients. 

6. The EPG system of claim 4, wherein the PIG generator in real time selects one 
pixel out of the nine pixels based on a transfer function of (a + 2b + c +2d +4e +2f + g + 2h 

30 +i)/16, wherein a, b, c, d, e, f, g, h, and i are binary coefficients for the respective pixels in the 
3x3 sliding window. 

7. The EPG system of claim 1, further comprising means for displaying in the PIG 
window information about a television program. 

35 

8. The EPG system of claim 1, further comprising: 

means for displaying television program listings in a first area of the screen; 
an input device to selectively mark one of the displayed program listings; and 

-7- 
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1 means responsive to the input device for controlling the display generator to display 

in the PIG window simultaneously with the program listings video clips of the marked program. 

9. The EPG system of claim 8, wherein the marked program is a currently telecast 
5 television program and the video clip is a live telecast of the marked program. 

10. The EPG system of claim 8, wherein the marked program is a future telecast 
television program and the video clip is a preview of the marked program. 

10 1 1 . A television system for receiving a video signal, comprising: 

a monitor having a display screen; 

a plurality of tuners to generate a plurality of video signals that carry video 
programs and data related to the video programs; 

a PIG chip coupled to the monitor and the tuners to display a first image in a PIG 
1 5 window on the screen based on a video signal generated by one of the plurality of tuners, wherein 
the PIG chip performs a real time weighted averaging to select one pixel out of nine pixels from 
the video signal to display the respective program in the PIG window on the screen; and 

means for coupling the program related data to the PIG chip so as to display the 
data in a second area on the screen contemporaneously with the program displayed in the PIG 
20 window. 

12. The television system of claim 1 1, further comprising a memory to buffer pixels 
corresponding to a subset of the generated video signals. 

25 13. The television system of claim 12, wherein the memory buffers 3 adjacent pixels 

in a 3x3 sliding window for the current line and the previous two lines of the video signal 
generated by one of the plurality of timers, and the PIG chip performs the real time weighted 
averaging to select one pixel out of the nine pixels in the sliding window. 

30 14. The EPG system of claim 1 3, wherein the PIG chip in real time selects one pixel 

out of the nine pixels based on a transfer function of (a + 2b + c +2d +4e +2f + g + 2h +i)/16, 
wherein a, b, c, d, e 5 f, g, h, and i are binary coefficients for the respective pixels in the 3x3 
sliding window. 

35 1 5. A method for providing video data to a picture in guide (PIG) window displayed 

on a monitor, the method comprising the steps of: 
receiving a video signal; 

generating pixels based on the received signal; 

-8- 
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performing a real time weighted averaging to select a subset of the pixels; and 
displaying the subset of the pixels in the PIG window on the monitor. 

16. The method of claim 15, further comprising the step of buffering the generated 

pixels. 

17. The method of claim 16, wherein the step of buffering comprises buffering 3 
adjacent pixels in a 3x3 sliding window for the current line and the previous two lines, and the 
step of performing a real time weighted averaging comprises performing the real time weighted 
averaging for selecting one pixel out of the nine pixels in the sliding window. 

18. The method of claim 17, wherein the step of performing a real time weighted 
averaging comprises selecting one pixel out of the nine pixels based on a transfer function of (a 
+ 2b + c +2d +4e +2f + g + 2h +i)/16, wherein a, b, c, d, e, f, g, h, and i are binary coefficients 
for the respective pixels in the 3x3 sliding window. 

19. The method of claim 15, further comprising displaying in the PIG window 
information about a television program. 

20. The method of claim 15, further comprising: 

displaying television program listings in a first area of the screen; 
selectively marking one of the displayed program listings; and 
controlling the display generator to display in the PIG window simultaneously with 
the program listings video clips of the marked program. 

21. The method of claim 20, wherein the marked program is a currently telecast 
television program and the video clip is a live telecast of the marked program. 

22. The method of claim 20, wherein the marked program is a future telecast television 
program and the video clip is a preview of the marked program. 
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AMENDED CLAIMS 

[received by the International Bureau on 15 August 2000 (15.08.00); 
original claims 1 and 15 amended; remaining claims unchanged (3 pages)] 

1. An electronic program guide (EPG) system including a picture in guide (PIG) 

window comprising: 
5 a monitor having a display screen; 

a tuner to generate a video signal; 

a decoder coupled to the tuner to receive the video signal and generate pixels based 

on the received signal; 

a PIG generator coupled to the decoder that performs a real time weighted 
1 0 averaging to [select] generate a subset of the pixels as a line of pixels is generated by the decoder ; 
and 

a display generator to display the subset of the pixels in the PIG window on the 
display screen. 

15 2. The EPG system of claim 1, wherein the PIG generator performs the real time 

weighted averaging to select one pixel out of nine pixels. 

3 . The EPG system of claim 2, further comprising a memory to buffer the generated 

pixels. 



20 



25 



30 



4. The EPG system of claim 3, wherein the memory buffers 3 adjacent pixels in a 3x3 
sliding window for the current line and the previous two lines, and the PIG generator performs 
the real time weighted averaging to select one pixel out of the nine pixels from the sliding 
window. 

5. The EPG system of claim 1, wherein the PIG generator performs a real time 
polynomial weighted averaging with binary coefficients. 

6. The EPG system of claim 4, wherein the PIG generator in real time selects one 
pixel out of the nine pixels based on a transfer function of (a + 2b + c +2d +4e +2f + g + 2h 
+iy 1 6, wherein a, b, c, d, e, f, g, h, and i are binary coefficients for the respective pixels in the 
3x3 sliding window. 



7. The EPG system of claim 1 , further comprising means for displaying in the PIG 
35 window information about a television program. 

8. The EPG system of claim 1 , further comprising: 

means for displaying television program listings in a first area of the screen; 
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an input device to selectively mark one of the displayed program listings; and 
means responsive to the input device for controlling the display generator to display 
in the PIG window simultaneously with the program listings video clips of the marked program. 

9. The EPG system of claim 8, wherein the marked program is a currently telecast 
television program and the video clip is a live telecast of the marked program. 

10. The EPG system of claim 8, wherein the marked program is a future telecast 
television program and the video clip is a preview of the marked program. 



11. A television system for receiving a video signal, comprising: 
a monitor having a display screen; 

a plurality of tuners to generate a plurality of video signals that carry video 
programs and data related to the video programs; 
1 5 a PIG chip coupled to the monitor and the tuners to display a first image in a PIG 

window on the screen based on a video signal generated by one of the plurality of tuners, wherein 
the PIG chip performs a real time weighted averaging to select one pixel out of nine pixels from 
the video signal to display the respective program in the PIG window on the screen; and 

means for coupling the program related data to the PIG chip so as to display the 
20 data in a second area on the screen contemporaneously with the program displayed in the PIG 
window. 

12. The television system of claim 1 1 , further comprising a memory to buffer pixels 
corresponding to a subset of the generated video signals. 

13. The television system of claim 12, wherein the memory buffers 3 adjacent pixels 
in a 3x3 sliding window for the current line and the previous two lines of the video signal 
generated by one of the plurality of tuners, and the PIG chip performs the real time weighted 
averaging to select one pixel out of the nine pixels in the sliding window. 

14. The EPG system of claim 1 3 , wherein the PIG chip in real time selects one pixel 
out of the nine pixels based on a transfer function of (a + 2b + c +2d +4e +2f + g + 2h +i)/16, 
wherein a, b, c, d, e, f, g, h, and i are binary coefficients for the respective pixels in the 3x3 
sliding window. 

15. A method for providing video data to a picture in guide (PIG) window displayed 
on a monitor, the method comprising the steps of: 

receiving a video signal; 
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1 generating pixels based on the received signal; 

performing a real time weighted averaging to [select] generate a subset of the pixels 
as a line of pixels is generated bv the decoder : and 

displaying the subset of the pixels in the PIG window on the monitor. 

5 

16. The method of claim 15, further comprising the step of buffering the generated 

pixels. 

17. The method of claim 16, wherein the step of buffering comprises buffering 3 
1 0 adjacent pixels in a 3x3 sliding window for the current line and the previous two lines, and the 

step of performing a real time weighted averaging comprises performing the real time weighted 
averaging for selecting one pixel out of the nine pixels in the sliding window. 

18. The method of claim 17, wherein the step of performing a real time weighted 
1 5 averaging comprises selecting one pixel out of the nine pixels based on a transfer function of (a 

+ 2b + c +2d +4e +2f + g + 2h +i)/16, wherein a, b, c, d, e, f, g, h, and i are binary coefficients 
for the respective pixels in the 3x3 sliding window. 

19. The method of claim 15, further comprising displaying in the PIG window 
20 information about a television program. 

20. The method of claim 15, further comprising: 

displaying television program listings in a first area of the screen; 
selectively marking one of the displayed program listings; and 
25 controlling the display generator to display in the PIG window simultaneously with 

the program listings video clips of the marked program. 

21. The method of claim 20, wherein the marked program is a currently telecast 
television program and the video clip is a live telecast of the marked program. 



30 



22. The method of claim 20, wherein the marked program is a future telecast television 
program and the video clip is a preview of the marked program. 



CMR PAS266788. 1 -*-8/10/00 2:05 PM 
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